Skip to content

Improve resource/topic wait script #261

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Jul 21, 2025
Merged

Improve resource/topic wait script #261

merged 4 commits into from
Jul 21, 2025

Conversation

maltesander
Copy link
Member

In create-spark-ingestion-job:

  • improve wait for resources (nifi,kafka,minio)
  • improve wait for kafka topic to be ready (depend on nifi, nifi ingestion job) by checking topics and partitions

@maltesander maltesander requested review from razvan and dervoeti July 18, 2025 16:26
@maltesander maltesander self-assigned this Jul 18, 2025
dervoeti
dervoeti reviewed Jul 18, 2025
View reviewed changes
Copy link
Member

@dervoeti dervoeti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pre-commit complains about a trailing whitespace, else LGTM

Test on IONOS cluster was successful 🚀

@maltesander maltesander requested a review from dervoeti July 21, 2025 07:02
dervoeti
dervoeti previously approved these changes Jul 21, 2025
View reviewed changes
@maltesander maltesander enabled auto-merge (squash) July 21, 2025 08:10
@lfrancke lfrancke disabled auto-merge July 21, 2025 08:28
@lfrancke lfrancke merged commit 5fb32b0 into main Jul 21, 2025
1 check passed
@lfrancke lfrancke deleted the fix(lakehouse)/improve-resource-topic-checks branch July 21, 2025 08:29
razvan added a commit that referenced this pull request Jul 21, 2025
@maltesander @razvan
Improve resource/topic wait script (#261)
c78f9c0 
Co-authored-by: Razvan-Daniel Mihai <[email protected]>
razvan added a commit that referenced this pull request Jul 21, 2025
@razvan @maltesander
Improve resource/topic wait script (#261) (#264)
04b6629 
Co-authored-by: Malte Sander <[email protected]>
razvan added a commit that referenced this pull request Jul 21, 2025
@maltesander @razvan
Improve resource/topic wait script (#261)
f8978b7 
Co-authored-by: Razvan-Daniel Mihai <[email protected]>
@razvan razvan mentioned this pull request Jul 21, 2025
Merged
razvan added a commit that referenced this pull request Jul 21, 2025
@razvan @maltesander
backport: lake demo, wait for resources (#268)
9d6b2b1 
* Improve resource/topic wait script (#261)

Co-authored-by: Razvan-Daniel Mihai <[email protected]>

* update broker url

---------

Co-authored-by: Malte Sander <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@razvan razvan razvan approved these changes

@dervoeti dervoeti dervoeti left review comments

Assignees

@maltesander maltesander

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@maltesander @razvan @dervoeti @lfrancke